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DECLARATION PURSUANT TO 37 C.F.R. 1.131 

We, Kurt Hertogs and Rudy Jean Marc Mortier, declare as follows: 

1 . We are two of the five named inventors in the above-identified application. 

2. We have read the specification and the claims as originally filed in the 
application and as presented in the pending claims shown in the attached Exhibit A. Each of 
us, together with Brendan Larder, Stuart Bloor and Pascale Alfons Rosa Dehertogh, 
contributed to the conception of the invention as defined by one or more of the claims as set 
forth in Exhibit A. 

3. Before March 2000, we completed the invention in this country, or in a 
NAFTA country, or a WTO member country. Our actual reduction to practice of the claimed 
invention, directly or through persons under our direction and control, before March 2000, is 
evidenced by the following: 

A. Attached as Exhibit B is a true and accurate copy (except for redaction 
of dates) of witnessed report, prepared by Kurt Hertogs ("the Hertogs Report"). Hertogs 
memorializes the claimed invention as shown in Exhibit A. The Hertogs Report at Exhibit B, 
is dated prior to March 2000. 
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B. The Hertogs report discloses in Exhibit B at page 4, Tfl .1, the "System 
and System Features to be tested" which discloses the steps as claimed in pending claim 1 . 

C. The Hertogs report discloses in Exhibit B "VircoGen II, i.e., the 
prediction of genotypic resistance based on available phenotypic data." (see Exhibit B at page 
4,UL1). 

D. The Hertogs report in Exhibit B at page 4, If 1.1, describes, in detail, 
new steps to validate the calls based on phenotypic data. The new steps include: 

1 . Create Hot Spots from rules, or use a set of 
predefined Hot Spots (preferred) (see Exhibit B at page 4, Ifl.l). 

2. Import a reference set of genotypic and phenotypic 
data (AV_Data). The program will identify sequences belonging to each 
Hot Spot and link them to the Hot Spots (see Exhibit B at page 4, f 1 . 1). 

3. From the Hot Spots "Special" button, recalculate 
the Phenotypic Sets. This will link the set of corresponding phenotypes to 
each Hot Spot (see Exhibit B at page 4, f 1 . 1). 

4. For each test sequence, a report is created using the 
new method to determine genotypic resistance. A set of "Profiles" is 
automatically calculated for each drug. A profile consists of a set of Hot 
Spots (either positive or negative). To belong to a profile, a test sequence 
must have an identical profile. The mean and median phenotypic 
resistance are also calculated for each Profile (see Exhibit B at page 4, 

ni.i). 

E. The Hertogs report discloses in Exhibit B at page 8 examples of drugs 
used in the method as claimed. 

F. The Hertogs report discloses in Exhibit B at page 8 the following note: 
"he[sic] phenotypes and sequence data should be imported, the hot spots should be correct 
and the phenotype set should be calculated before starting the test script." 

G. The Hertogs report discloses in Exhibit B at page 21 various fields in 
an Excel file which include: sequence identifier; drug (compound tested), fold resistance 
observed in the antivirogram linked to a sequence; phenotypic call for the real data; and 
original virtual fold resistance. 

H. The Hertogs report discloses in Exhibit B at page 24 under the header 
"7. Test Summary Log" the following: "Verify the scoring of genotypic calls in the 
VircoGen™ database (virtual phenotypes)". 

I. The Hertogs report in Exhibit B therefore shows in detail all the steps 
to be performed to arrive at the result as claimed in Exhibit A. 

Page 2 of 3 



DOCKET NO.: TIBO-0029 PATENT 

Application No.: 09/836,477 

Office Action Dated: November 2, 2005 



4, All statements made herein of our own knowledge are true and that all 
statements made on information and belief are believed to be true. These statements were 
made with the knowledge that willful false statements and the like so made are punishable by 
fine or imprisonment, or both, under Section 1001 of Title 18 of the United States Code, and 
that such willful false statements may jeopardize the validity of the application or any patent 
issuing thereon. 

&6 2^>^<<> 




>ate 



Date 




Rudy Jean Marc Mortier 



489338 



# 



Page 3 of 3 



EXHIBIT A 

U.S. Application No. 09/836,477 
Filed April 18, 2001 

Pending Claims 

I. Listing of Claims: 

1 . (Previously Presented) A method of determining a phenotype of a 
retrovirus, wherein the retrovirus is the Human Immunodeficiency Virus, comprising: 

a) obtaining a genetic sequence of the Human Immunodeficiency Virus; 

b) identifying a mutation pattern of the genetic sequence of the Human 
Immunodeficiency Virus, wherein said mutation pattern comprises at least one mutation that 
correlates to resistance to at least one therapy; 

c) searching a relational genotype/phenotype database for at least one database 
mutation pattern similar to said mutation pattern of the genetic sequence of the Human 
Immunodeficiency Virus; 

d) obtaining at least one database phenotype of the at least one database mutation 
pattern; and 

e) determining the phenotype of the Human Immunodeficiency Virus from the at 
least one database phenotype. 

2. (Original) The method of claim 1, wherein a series of phenotypes is 
obtained by repeating steps b) through e) for each therapy in a group of therapies. 

3. (Previously Presented) The method of claim 1, wherein said mutation 
pattern of the genetic sequence of the Human Immunodeficiency Virus is specific to a 
therapy. 

4. (Previously Presented) The method of claim 1, wherein the Human 
Immunodeficiency Virus is obtained from at least one of a plasma sample, a blood sample, a 
saliva sample, mucous sample, and a tissue sample. 
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5-7. (Canceled) 

8. (Previously Presented) The method of claim 1, wherein said at least one 

mutation is chosen from a frame shift mutation, a base substitution, and an epigenetic 
mutation. 

9-12. (Canceled) 

13. (Previously Presented) The method of claim 1, wherein the genetic 
sequence of Human Immunodeficiency Virus is the genetic sequence of the protease region 
of the Human Immunodeficiency Virus genome, the genetic sequence of the reverse 
transcriptase region of the Human Immunodeficiency Virus genome, or the genetic sequence 
of the protease region and reverse transcriptase region of the Human Immunodeficiency 
Virus genome. 

14-15. (Canceled) 

16. (Previously Presented) The method of claim 1, wherein said mutation 
pattern of the genetic sequence of the Human Immunodeficiency Virus comprises at least two 
mutations that correlate to resistance to at least one therapy. 

1 7 . (Original) The method of claim 1 , wherein the search of the relational 
genotype/phenotype database for at least one sample with a similar mutation 

pattern uses cluster searches. 
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Pending Claims 

18. (Previously Presented) The method of claim 1, wherein the database 
mutation pattern comprises at least one mutation found in said mutation pattern of the genetic 
sequence of the Human Immunodeficiency Virus. 

19. (Previously Presented) The method of claim 1, wherein the database 
mutation pattern is a mutation pattern in which at least about 50% of the mutations are 
identical to said mutation pattern of the genetic sequence of the Human Immunodeficiency 
Virus. 

20. (Previously Presented) The method of claim 19, wherein the database 
mutation pattern is a mutation pattern in which at least about 80% of the mutations are 
identical to said mutation pattern of the genetic sequence of the Human Immunodeficiency 
Virus. 

21 . (Previously Presented) The method of claim 20, wherein the database 
mutation pattern is a mutation pattern in which at least about 90% of the mutations are 
identical to said mutation pattern of the genetic sequence of the Human Immunodeficiency 
Virus. 

22. (Previously Presented) The method of claim 21, wherein the mutations 
of the database mutation pattern are identical to said mutation pattern of the genetic sequence 
of the Human Immunodeficiency Virus. 

23. (Previously Presented) The method of claim 1, wherein the phenotype 
of the Human Immunodeficiency Virus is a mean fold-change in resistance, wherein said 
mean fold change is obtained from all of the database phenotypes obtained in step d). 
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Pending Claims 

24. (Previously Presented) The method of claim 1, wherein the phenotype 
of the Human Immunodeficiency Virus is expressed as an IC50. 

25. (Previously Presented) A method of reporting a phenotype for a Human 
Immunodeficiency Virus, comprising generating a report having the phenotype determined 
using the method of claim 1 . 

26-27. (Canceled) 

28. (Previously Presented) A method of determining a phenotype of a 
retrovirus, wherein the retrovirus is the Human Immunodeficiency Virus comprising: 

a) obtaining a genetic sequence of the Human Immunodeficiency Virus; 

b) searching a relational genotype/phenotype database for at least one database 
genetic sequence similar to said genetic sequence of the Human Immunodeficiency Virus; 

c) obtaining a database phenotype of the at least one database genetic sequence; and 

d) determining the phenotype of the Human Immunodeficiency Virus from the 
database phenotype. 

29. (Previously Presented) The method of claim 28, wherein the at least one 
database genetic sequence is at least about 60% identical to the genetic sequence of the 
Human Immunodeficiency Virus. 

30. (Previously Presented) The method of claim 29, wherein the at least one 
database genetic sequence is at least about 70% identical to the genetic sequence of the 
Human Immunodeficiency Virus. 
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Pending Claims 

3 1 . (Previously Presented) The method of claim 30, wherein the at least one 
database genetic sequence is at least about 80% identical to the genetic sequence of the 
Human Immunodeficiency Virus. 

32. (Previously Presented) The method of claim 31, wherein the at least one 
database genetic sequence is at least about 90% identical to the genetic sequence of the 
Human Immunodeficiency Virus. 

33-38. (Canceled) 

39. (Previously Presented) A computer program for determining a 
phenotype of a retrovirus, wherein the retrovirus is the Human Immunodeficiency Virus, 
wherein the program is comprised on a computer readable medium, comprising: 

a) receiving a genetic sequence from the Human Immunodeficiency Virus from a 

patient; 

b) identifying a mutation pattern of the genetic sequence of the Human 
Immunodeficiency Virus, wherein said mutation pattern comprises at least one mutation that 
correlates to resistance to at least one therapy; 

c) searching a relational genotype/phenotype database for at least one database 
mutation pattern similar to said mutation pattern of the genetic sequence of the Human 
Immunodeficiency Virus; 

d) obtaining at least one database phenotype of the at least one database mutation 
pattern from the relational genotype/phenotype database; 

e) determining the at least one phenotype of Human Immunodeficiency Virus from 
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Pending Claims 

the at least one database phenotype; and 

f) providing the phenotype of the Human Immunodeficiency Virus sample. 

40. (Original) The computer program of claim 39, wherein a series of 
phenotypes is obtained by repeating steps b) through e) for a group of therapies. 

41 . (Previously Presented) The computer program of claim 40, wherein the 
phenotype of the Human Immunodeficiency Virus is provided in a report. 

42. (Canceled) 
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Test Script for the Validatioivof 

VIRIS. \ 

Laboratory Management 
Information System (LIMS) 

TS*VG-Genotype Calls 

Edition Nr 3 



\ 
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Revision History 


Version 


Date 


Reason 


1 




Validation of the Genotypic calis in 
VircoGen 


2 




Validation of VircoGen II 


3 




Validation of data cleaning routine 
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1. Purpose 

1.1 System and System Features to be tested 

The present Test Script verifies the core functionality of VircoGen H, i.e. the prediction of 
^enotypic resistance based on available phenotypic data. The analysis is based performed 
on the same data set used to- validate VircoGen™ {rule-based interpretation) The latter 
validation consisted of three steps : 

- Alignment of reference and test sequences 

- Selection of the "documented" mutations (i.e. the mutations known or suspected to 
cause resistance) 

- Rule-based analy sis of the documented mutations. The genotypic data werescored 
as follows :■ 

- No evidence of resistance (green score) 

- Resistance possible (orange score) 

- Evidence of resistance (red score) 

The new steps to validate the calls based on phenotypic data include : 

- Create Hot Spots from rules, or use a set of predefined Hot Spots (preferred) 

- Import a reference set of genotypic and phenotypic data (A V_Data) . The program will 
identify the sequences belonging to each Hot Spot link them to the Hot Spots. 

- From the Hot Spots "Special" button, recalculate the Phenotype Sets. This will link the 
set of corresponding phenotypes to each Hot Spot 

- For each test sequence, create a report using the new method to determine genotypic 
resistance. A set of "Profiles" is automatically calculated for each drug. A profile 
consists of a set of Hot Spots (either positive or negative). To belong to a profile, a test 
sequence must obey to all of the positive Hot Spots, and may not belong to any of the 
negative Hot Spots. The Mean and Median phenotypic resistance are also calculated for 
each Profile. 

In addition the routine to clean the data based on the 3sigma levels needs to be validated. 

All calculations must be performed in VircoGen. H, and in parallel using a dedicated Excel 
file mat performs identical calculations, or a statistical packagesuch as Statjsttca. 



1.2 Reference Documentation 

The documents references in this Test Script are the related Validation Plan and Test Plan, 
which are based on the EU Annex It Guidelines. 

Other reference documentation includes the VIRIS User Manual and the System Design 
Specificafions which are used to optimise the computer program during the testing and 
implementation phase. 
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2. Special Requirements 



Special Requirement . 


Description 


Prerequisite procedures 


• Preparation of a genotype-phenotype analysis programs in Excel : 

• - Profile Tempiaie.XLS 

• - Pheno-Spread Ternplate.XLS 

• Report Data Template.XLS 


Special skills required 


# Thorough knowledge of VircoGen IL Excel and Statistica 

• Kno wledge of the 4D Quick Report Editor 


Environment requirements 


Power PC with at least 64 Mb of internal memory 
* IBM compatible, computer running Statistica 



3. Test Approach 

This section describes the approach to be followed for : 
1 > Specifying the tests (Test Script), 
2. Executing the Test Script and completing the Test Log* 
3,. Resolution of unexpected events. 



3 J Test Preparation 

A Test Script consists of a number of steps that are executed sequentially. Each step 
specifies the action to be performed, the results that are expected, and the pass/fail criteria 
for the test. The steps to be executed are specified in section 4 of this Test Script. 

3.2 Test Execution Procedure 

1 . The Test Script is also the template for the Test Log. Before executing the Test Script, a 
copy of this Test Script is made and the title is changed to identify it as appropriate Test 
Log. 

2. When a step is executed, the actual result is entered in the Test Log to mark its 
completion. 

3. For each step, the observed arid expected results are compared The tester writes "pass" 
or "feil" in the space provided, depending on the outcome. 

4. Section 5 of the Test Log describes all errors and all anomalies observed. Anomalies are 
any observations of system behaviour that is not expected. 

5. Section 6 of the Test Log describes notes that are required to interpret correctly the 
observed behaviour of the system. Abnormal environmental conditions are also noted- 
Test criteria that are not set correctly may require that updated criteria are used arid the 
test continued. This will also be explained by means of an explanatory note, 

6. At the completion of all procedure steps, a Test Summary is written. 
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3.3 Resolution of Unexpected Events 

Anomalies are noted and discussed with the IT Director who will perform further sicrtons. 
These actions have to be documented in an "Anomaly and Change Request Form* . 
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4, Test Script Steps & Test Log 

Instructions For Building the Test Script 

► Describe any preparation that is required before, the test can be carried out 

♦ Describe the set of input data that are used (test case). 

♦ Describe the Test Procedures, A. Test Procedure may consist of a number of steps that are performed in a 
specified sequence 

♦ Describe the steps necessary to accomplish the Test Procedure. Write e\acdy what the tester will do and 
what will be the input to this step 

♦ List the results that are expected or refer to an appended sheet or printout. There may be a number of 
expected results, depending on the complexity of the test you are performing. 

♦ State what are the pass/fail criteria for the tests, 

» The length of the test procedure will depend on the complexity of the te st, to be performed. 

The following table describes the various steps to be r^rformeci to test the feature or set of 
features tot will be tested in this test script. The Test Log entries and the list of anomalies 
(^unexpected results) are completed when executing the script. 
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wcH:vxrv< ANt> PROFILES Test Procedures 


Test L 






Procedure / Steps 


Expected Result 


Pass 
Fall 


Note 
Log 


Anomaly 


; Stan' VireoGen 11 


Mam screen and menu appear 








Open File - Test Sequences 


The main view of the sequences table 
Appears. 








For a test sequence from Test Case I, 
execute, the. "Analyse Sequences" program 
from the "Special*" button. Select the 
-Resistance'* analysis. Copy the result 
screen to the clipboard. . 


The screen can be pasted m Word. 
File created : 'Rule Analysis Results" 








Open the ''Interpretation Settings" and set 
the "Minimum amount of matches needed 
for imeipreiation" to a value- of J000 
(above the number of sequences in the 


When creating a report, the Database Pheno . 
^7irf*f»ri 11? til nnt hft calculated vet. 








Open the Test Sequences and make: a report 
for the sequence your are working on. To 

-i ~_ *u;., iieo, rK» ^^Jtxavi!*-)* 7 * hntwn **C in&3tc 
GO ID J St uSc liie j>pCCu« UUUwH v~it-a*^- 

Reports*. 

-Respond "No* fo the question ^Save 
Analysis Data". 


An R in front of tlie Sequence indicates that 
the report has been generated. 

The profiles are NOT saved to the table 
-'MedianFR Values*. 








Oo to tne Keports laoie anu pi 1 ** 1 - * lj v 
report on paper. 


Report is printed; 

All results should be calculated using the. 
rules (Rule^based interpretation)* 








Compare the genotype calls obtained from 
the "Analysis" (in Rule Analysis Results 
Excel fiie) with the results on the reports. 


The results should be identical, since they are 
both obtained using a rule-based 
interpretation. . 








Open the Excel file ""Profile 
Template.XLS" and copy the sequence you 
are wonong on in row & w u*c Mitiunicw 
worksheet. 


The 2^ worksheet (Virco ID) is updated with 
the new sequence information 








Select the rows for which the In Report 
vawe (M>*umn jjus ijiv*^ 


A subset of rows containing documented 
rnuations is shown. 








Compare the mutations with the mutations 
on the picture of the report printed 
from VircoGen II 

Ado* the Mixtures and inserts in the box 

under the Drug and Mutations 
columns (if needed). , 


The mutations should automatically be 
highlighted in yellow in the Hot Spots 
below. 








Manually score the Hot Spots, Put 1 or 0 
depending if the sequence obeys 
tne riot opot or nou 


the "Excel Profile" in the * < Profite ! " 
worksheet should be filled out correctly. 








Print the **Virco ID" worksheet. 


The worksheet is printed in landscape on twe* 
pages (one for the sequence data and one. for 
the Hot Spots). 








in VircoGen II. open the Test Sequences 
and make a new report for the sequence 
your are working on. To do this, use the 
^Special" button '^Create Reports''. 
Respond '"Yes" to the question "Save 
Analysis Data". 


New reports are generated for the sequences. 

tne profiles are. saved to the table 
"MedianFR Values" 








Qpfen the table ^yfedianFR Values" and 


The profiles are saved to a text file. . 
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export the- drug name and profile (using 
vfte Quick Report Kd?tor behind the Print • 
button), 


Archive these files in a folder. 








Go to the -Profiles-" sab of the Excel file 
and paste the dm& aner profile in the first 
; two columns of the sheet. 


The drug s should be- pasted in the following . 
order : 

Saquinavir 
Ritonavir 
Indinavir 
DMP-266 
Oetavirdine 
Neviraptoe 
Nelfinavir 
1592 U89 
3TC 
; d4T 
ddC 
AZT 
ddl 








Compare Hie profile obtained by 4t> 
; (pasted) with the proHle calculated using 
Excel. If everything is OK, a green value 
"TRUE** will he dispiayed in the last 
r coUmrn of the "Profiles" sheet If not, a 
. red "FALSER will appear. _^ 


The profiles, from Excel should bfc identical 
to the scores from the VircoGen™ program. 

in ft-^f r- r>.T-rc>.r^*\ f\w nf f*\tf*nri%zk\ mstmjil ftirors^. 
(aJter CDITcCIIOI] t?i cvciuuai maimo* vnvwy> 








Repeat this analysis for each Test 
Sequence from Test Case 1 or quit 
VircoGen 1 ** . Excel and Word. 


. New analysis executed or quit programs. 









Je$t Case 1 



The following 28 sequences tVirco Ids) were used as test cases : 
101968 102636 103076 
102360 10264S 103084 
102364 102657 103110 
102382 102660 103111 
102448 102663 103129 
102459 102691 103173 
102488 102718 105521 
102611 102736 110126 
102631 103067 
102635 103070 

Note : he phenotypes and sequence data, should be imported, the hot spots should be. correct and the genotype set 
should be calculated before starting the test script. 
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iiOTCTPttfetATiON" SETTINGS test Procedures 



Test Log 



Procedure / Steps 



Expected Result 



Fa*s 
Fail 



Note 
Leg 



no ma I j 

m 



Start VitfoGen t* 



Main screen and menu appear 



Open. File - Test Sequences 



: Thcmaixi view of the sequences table 
[.appear^ 



: Open .ike -inieipretation- Settings** and set 
the "Minimum amount of matches needed 
tor ifitfflrprfci-atio'ft" to a value of V000 
(above the number of sequences- m the 
databank 



When creating -a report: the Database Pfceno 
Spread will not be calculated yeu 



: Open the Test" Sequences and .make a report 
for the sequence your -arc. working on. To 
do Ms, use the. "Special" button "Create 
i Reports". 
Respond ''No*' to the question "'Save 
-sis Baur". , 



An £ in front of the Sequence indicates thai 
the report has been generated* 



The profiles are NOT saved io the table 
"MedianFR3-aiues", 



Analy .. 

Co to the Reports table and make a print 
of the Detail Screen (using f ! 2 with 
Flash- it active).. 



I Detail screen is printed. 
All results should be calculated using the 
rules (Rule-based interpretation)* 



Open the 'Interpretation Settings'* and set 
the '^Minimum amount of matches needed 

for interpretation" to a- value of .L 

Open the Test Sequences and make a report 
■ for the sequence your are working on. To 
do this, use the "Speciar button. i; Create 
Reports". 

Respond ' W to the question -Save 
Analysis Data" 



When creating a report, the Database Rheno 
[ Spread will be used when at least one result is 
available. . . 



A new report is generated* 



The profiles are NOT saved to the table 
^MedianFR ..Values"-. 



Go to the Reports table and make a print 
of the Detail Screen {using Ff 2 with 
Fiash-ii .active)., — 
Compare if the common data are identical 



Detail screen is printed. 
Ail results should he calculated using the 
profiles (when phenoiype data are available). 



Identical data : 

Mutations picture 
Drug name 

"Mutations identified** flag 
Matching rule 
Resistance call (SIR) 
MeanFR 

# . Sequences in set 

# Phenotypes in set 
Remarks 



Repeat this analysts fox each Test 
: Sequence from Test Case 1 or quit 
VircoGen^ 1 - Excel and Word. 



New analysis executed or quit programs. 



Create the same data using the research 
tool ''Engine Tcst^ 
(This is not a required test). 
Open the Test Sequences table, select ail 
records and execute "Test VG ft Engine" 
i under the Special button. 
Print the te$t data (Consolidation - 
Performed Tests) and detailed records 
(Consolidation - Test Results). 



Verify the results. They should match the 
dam m the Reports of the sequences (screen 
j dumps described above), 

A calculation is also performed to show the 
I; differences between the Real Medians 
obtained in the Antivirogram** test, and the 
results from the Rbeno spread. Ideally* no 
''level two" differences should be observed. 
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Test Case 1 t 
Same data as above. 
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PMO SPiHPAn T^i Procedures ^ „ 


Test V 


i 




Procedure / Meps 


i&xp&et&ti Result 


Pass 
Fail 


Note 


Anomaly 


StattVircoGeafl. 


Nfain screen and menu appear 








Open File - Hot Spelts . 


The main view of the hot spots 'list' appears*. 








Select aH hot spots corresponding to one 
drug. via. the 'Search 1 burton (see below for 
ID numbers}.. 


the hot $pots list contains ail hot $pots for 
the drug you selected. 10*$ should he in 
ascending order. 








Select a hot spot and open File - Test 
sequences. 


I nc test hctjvtcnc^> wmuvw ap^/vai - 

displaying all test sequences corresponding 








Select ail test sequences and export their 
ViiroTP's using the Quick Report behind 
the ; Print 7 button. 


Tab-delimited text file printed (temporary 
file). 








Paste the VircolD's hi the 'profiles'iab of 
the "Pheno-spvead template. xls**Excef 
Ftie. Use the correct column of the Profile 
window (column I to 9). 


Virco Ids pasted in. correct column of Profile 
window. 








Do the same steps for every hot spot for 
the drug you're working on. 


All Vjtco Idscop&d into Profile window. 








From the 'Mean and Median 28 sequences 1 
tab m the Pheno-spread Excel file select 
the drug you are working on. Print the 
result* 

Note : this tab was imported from 
VircoGenU. . 


Printed copy with name of the drug, profiles j 
and mean and median FR. 








In the 'Profiles' tab fill in the first profile 
in the yellow profile tow. Print this page. 


The "Resati column identifies all VircolD's of 
the test sequences that are positive for that 
profile (identified by . 








Select the '' XV_data * tab and filter the drug 
column for the correct drug and the ^In 
profile" column for Yes , 


The FR and Resistance level ate displayed "m 
me i*auerit_rK cot urn n anu trip ros^jcvc* 
column respectively. 








Paste the data front the latter two columns 
to the A and B columns under the header 
"Table*. Print the- resulting page. 
This is needed because otherwise "hidden" 
results will be used to calculate the Means, 
Median and Rcsi$tance values. 


Mean and median are calculated, counts and 
percentages for low, medium arid high level 
resistance are given are presented 
numerically and graphically. 
The profile results are primed for that dru.g, 








'. Do the same for each profile for the drug 
you are working on. | 


All Profiles calculated and printed. 








For ail profiles, compare the mean and 
media n FR calculated in Excel with the 
mean and median FR in the 'Mean and 
Median 2S sequences' tab. 


All results have to be the same. 








For the profile 000000000 look up all 
corresponding Virco ID's and their 
pnenotypic uara ^patient- .jtivj. >. xai.*.t* 
you find in the AV_data list that you 
access vi:a the File_Show phenotypic data 
menu in VlreoGenf L Calculate the mean 
and median FR. and compare with, the mean 
and median FR in the 'Meanaasl Median 
28 sequences* tah* 

Write the results on the printed copy with 
name of the drug, profiles and mean and 
median FR. 


The mean and medians obtained using the 
manual method should equal the data obtained 
by 4D. 
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Repeat this analysis for each drug or qmi J AH -results OK or quit VhcoGcn It 
ViTcoGcfl& Excel and Wop& { — - 



T*st Case 1 : 
Same data as above. 



Note t drug IDs : 
t : Saquinavir 

2 : Ritonavir 

3 : Indinavir 
. 4 ; DMP266 

5 : De&virdine 

6 : Nevirapiite 

~ 7 : PMEA (do nouest) 
S : Nelftnavir 

- 9-1592 US9 

- 10 : 3 TC 

- tJ:T>4T 
~ 12 : DDC 
. J3;AZT 
. 14 : DDI 

- 2756 : VX-478 (do not test) 
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4D - EXCEL COMPARISON Test Procedures _ - 


Test L< 






Procedure / Steps 


Expected Result 


Pass 
FaH 


Note 


Anomaly 


Start VircoGen It 


Main screen and menu appear 








Go to ^eport^daia" in ihe user 
environment; Export at least the 
following fields : 
Virco ID 

Generic Name ! 
Resistance (rule-based call) 
Meanjflft 


A Tab-delimited text file is generated 








Import this file in the Excel file 
"Report.Data 2S Templaicxls" and 
rename die file "ReponJDate 28 
sequences is". 

Make a column '"Drag** thai holds the 
preferred name. , 


Sheet 1 contains the Mean„FR (obtained 
from the pheno spread analysts) for each 
combination of Virco ID - Drug (3.64 
records). 








Open the Excel file ^nnnnnn^xls" in the 
folder "Step 1 - Profiles" and extract the 
. following information from the "Profiles" 
worksheet: 

VircOlD 

Drug 

Profile 

Paste this information in Sheet 2 of the 
file "Report J>ata 3S seejuences.xls*'. 


Sheet 2 tells to which profile each 
combination of *Virco ID - Drug" belongs. 
This means that the mutations observed for 
that sequence {Virco ID) belong to these sets 
of Drug - Profiles (364 records) 








Go to ihe ^MedianFR^Values'* table in 
VircoGen II and export all the daia to a 
tab-delimited text file : 

Drag 

Profile 
- Mean_FR 

Median„FR 
Import this file in Sheet 3 of the Excel file 
"Report_Pata 28 sequenccs.xls" 
Make a column, that concatenates the Drug 
and Profile fields. 


Sheet 3 shows the Mean and Median FR 
values for each Drug- Profile (X60 records). 








In Sheet 4, combine the information from 
sheets 2 and 3 to create a 364-record table 
containing the following information : 

- VircolD 

- Drug 
Profile 

- Mean FR 

- Resistance tpaseu on rucno apicuu/ 
Make a column mat compares the Mean 
FR values between Sheet 4 and Sheet }. 


This table should now contain the same 
information. as in Sheet 1. The difference is 
that mis sheet was generated using Excel 
data, while sheet I was exported from 4D. 








Make a column that compares the 
resistance calls between Sheet 4. and 
Sheet I, 


Verify die difference. These indicate a 
difference between the rule-based 
interpretation (VG 0 and the interpretation 
based on the. pheno-spread (VG 11). 
It is not the intention of this validation to 
discuss the differences* 
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Tftst page- |.„;, 
Same <&ta as above. 



Note ; 



Graphical presentation, of the steps performed to this script to verify the means: 

Sheet 4 * Sheet ST* 



S heet I 



4D Export 



364 Records 

.Sequence 
"Drug: 

L 



Sheet "2 



Excel 



364 Records 

-Seqaenct; 

Drag 

Profile 



Sheet 3 
4D (Excel 
validated} 



160 Records 



Drug 
Profile , 
Mean 



Excel Combination 



364 Records 

Drug 

Profile 

Mean 
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^TAflSTiCS Test Procedures. (1) ... 
Procedure / Steps- 


Expected Result 


Test L 

Pass 

Fail 


0ft. 

Note 
MR 


Anomaly 


Start VircoGan >I using the production 

<-J<it-T-iK<i c*x /"^fttiminc filf t'rtlYciCt Hoi SoOtS'.. 

. -and aft available genolypic and 
plienotvpic <i^ta Of the Virco database. 


Main screen and menu appear. 

"Hie dambaivc should contain about 20000 

genotypes and 350006 AY^Data. ' 








. MedianFR ; Yates iabtes. 


Tables should be empty. 


C . 






Go to the Hot Spots and recalculate all 

BnCftOtYpe Scl> -US t tig mcuu 

'-Recalculate phenotype sets~ from the 
"Special" button. 


The sets should be recalculated 


f 






Import the sequences from Test Case 1, 


Trie 28 sequences should he imported, and 
they should, automatically be linked to the 
correct Hot Spots. 


r\ 






Create reports for these sequences. 
Save the analysis results. 
Prim the reports. . 


The 2& reports should be generated and 
printed. 








Go to the Research menu ^Consolidation - 
Show Saved Analysis- 
Select a record, from Test Case 2 (Virco ID 
- Drug) and open the AV JT>ata table using 
The menu '-File - Phenotype Data**'. 
Export air records using ine yuicit ctopui i 
Editor (under die Print button). Export the 
following dam : 

Virco ID 

Drug 

Patient FR 
Resistance level 


All records exported into files. 








Repeat the step above for all drugs of the 
VircoIdsofTestCase2. . 


Al! records exported into files. 


ft™ 






Combine all the exports for one Virco It) 
into one Excel file. 


Two files should be generated (one for each 
of the test cases described in test Case 2). 








Import the file into the statistical program 
•'Statistical and perform the following 
' statistical analysis per drug : 

Descriptive statistics 

Frequency tables 

Plot Histograms 
For the Fold resistance, the Resistance 
level and the log of the fold resistance 


the statistics are performed and printed. 
Compare the results with the data obtained 
from 4D : 

Mean fold resistance 

Number of records for each of the 

Resistance classes 








Repeat the previous two steps widi the 
other Excel file. 

Quit Statistics, Excel and 4D. 


The statistics -are performed and printed. 
The results obtained using 40 and Statistica 
are identical.. 
All programs closed. 
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Test Case 1 t 

Same 28 sequences as uscrf above. 

These are imported in a database containing the complete sei of genotypes and phenotypes from the Virco 
database. 

Test Case 2 x 

AH togs of Virco ID j 1 0261.1 
103076 
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STATISTICS test Procedures (Correctness of data cleaning) 


Test Lou 




Procedure / Steps 


Expected Result 


Pass 
Fait 


Note 


Anomaly 

lop. 


Open Statistica and use Test Case i 


Stamtka opened and data available 








Perform descriptive Statistics to obtain 
means antd standard, deviations <oa the iog 
values) 


Statistics printed 








Calculate the 3-signia.Umits (mean ± 3 * 
standard deviation) of the log values 


3-signia limits calculated and introduced m 
Excel file 








Make a copy of the data set .. 


Data set copied 


Of* 






Delete the cases outside the 3-sigma limits 
(for each drag) 


Outliers manuairy removed 1 


4 — 1 — 






Perform the statistics : 
" - descriptive statistics 
frequency tables 
- . histograms 


Statistics performed and printed 


f 






Compare the means obtained using tjhe 
latter analysis with the original means 


All data should be identical 




A. 




Perform the same, validation for Test Case 
2, 











Text Case 1 : 

All drugs of Virco ID : 103076 
Name copy: 103076s3 



T?st tare % ; 

All drugs of Virco ID ; 10261 1 
Name copy: 1&261H3 
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STATISTICS Test Procedures Office ; 
Procedure / Steps 


of data cleaning) 

TT'vn**r-fr-pri Result 


Test hi 

Pass 

Fail 


Note 


Anomaly 
Lo.g 


lisetwo separate 4D servers and itart Test 
Cases 1 and 2. 


two 4D servers started. 








Go to the Hot Spots and recalculate all 
pfcenotype sets using the menu 
''Recalculate phenotype .sets" from the 
"Special" button. . _„ 


The sets should be recalculated on both 
servers. . ^ 


r 






Open the Sequences table, select data torn 
Test Case 3 and start the routine "Test 
Engine*" (from the Special Menu), 


The Test Engine selects the sequences for 
which both, genotypi'c and phenotypic data 
arc present &nu wuuuuti) iuv * uw«** 
phenorypes for these samples (on both 
servers). 


1 






Go to the Research menu ^Consolidation - 
MedianJFR values". 

Export all records using the Quick Report 
Editor (under the Print button). Export the \ 
fields described in test case 3* 


rieiuS expOfteci to * aurueiiiuHeu ttAt iuw> 
(about IQOOfr records on both servers?). 


t 






Create reports, for the first 30 sequences. 

Save the analysis results. 

Print the reports, .... 


The reports should be generated and printed 
(on both computers : original set and cleaned 
set). 








Quit VircoGen fi and open the two 
exported files in Excels Combine the 
results in a pairwxse manner so that the 
real, original and cleaned results for each 
drug are displayed on one line. 
Insert a column that calculates the 
difference between the "original" Call and 
the real Call and between the *'cleaned tr 
Call and the real Call . 


An Excel file containing the columns 
described, in 'Test Case 4". 

The 2 additional columns are calculated. 


t 






Import the file into the statistical program 

"Statistica" and perform the following 

statistical analysis : 

Descriptive statistics on all data 
Correlations on FR data 
Multiple regression on FR data 
Descriptive statistics on call 

differences 


The statistics are performed and printed. 
A correlation exists between the real data and 
the virtual calls- The cleaned results show a 
higher correlation than the original data. 


t 






Create new Statistica files in which die 
data arc transformed, so that a BY analysis 
can be performed This means that the 
dependent variables arc not in separate 
columns, but in one column with an 
accompanying Classification column. 
Classify the data by CLASS (Real, 
Original or Cleaned), 
Generate on file per drug. 


Statistica files generated per drug. The 
classification van awe cl^am can oe uscu w 
perform statistics BY class, and to generate 
categorised plots* 


r 






O rt ^fn^m tVta, £nl]s\Yvrn<r ct^trttirnl fln^tvet^ 
* err. OTTO tne lullOWliig &i<iu*ut-cu «wa* j 

on each of the datafiles (drug fdes) : 

- Descriptive statistics 

- Frequency tables 

- Plot Histograms 

- Box & Whisker plots 

on the Fold resistance data, Calls and Call 
differences (Matches). 


AH resulting listings and graphs are printed. 


A 

t 


% 
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I Quit Statistics, Excel aad the 4D servers. I All programs .close d- \ I I ,_ 1 
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program : 
Data : 



VircoGen II without gleaning*' module 
Complete copy of Virco UK production database. 
Latest version , of rules and Hot spots. 

Empty Reports. Median FR table and. Genotype results table. 



Program : VirtoGen II containing the "Cleaning" module ba.sed an the levels 

Data : Complete copy of Virco U K production. database- 

Latest version of rules and hot spots- 
Empty Reports, Median FR table and Phenotype results table. 



Test Case 3 : 

Sequences for which an Antivirogram exists. 
Make random selection of about 1000 Sequences. 

(note : tbe internal memory allows that maximum 1 200 sequences can be computed at once). 
Fields to be exported : 

Virco ID Sequence identifier 

Drug Compound tested 

Fold resistance obssrvedin the Antjvirogram ItaKed to 

a sequence 

CALL Pberioiypbcaf! (StfO forthe real data 



IfrSt Case 4 : 



Fields in Excel file 



Virco © 
Drug 

REAL.FR 

REAL_CAL 
QR^FR 

ORLCALL 

ORLMATCH 
CLEAtt_FR 



Sequence identifier 
Compound tested 

Fold resistance observed in the Antlyfrpgram linked to 



Phenotypicc^!.(S,LR) forme real data 

Original VIRTUAL fold resistance (before data 
cleaning) 

Original VIRTUAL phenotypic call {before data 
cleaning) 

Difference between ORl_CALL and REAL.CALL 
VIRTUAL fold resistance obtained after cleaning of the 
data 

CLEAN_CALL VIRTUAL Call obtained after cleaning of the datag 
CLEAN_MATCH Differ^cebeta^CLE^^ 
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5. Test Execution Notes 



Test Notes 


Notes Log NB 


Description m ■ „„ , ^ i 


A* 


f -JO * c (* t 


t 




I 
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6. Anomalies observed 



Anomaly Log 



Anomaly Log Nft Description 
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7. Test Summary Log 



Summary of Tests . 




Test Procedure 


Daie Performed 


initials 


Pass/Foil 


- Verify the scoring of genotypic calls in 
the VircoGen™ database (virtual 
phenotypes) 









8. Tester & Witness Signature and Date 



Name 


Title 


Signature I Date 


Tester yp ^Jj^ 






LJ 


Witness: u , / 

"r-^T—i 







9, Annexes 

Number of pages 



/ 
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